Self-Organized Discrimination of Resources

Self-Organized Discrimination of Resources

When selecting a resource to exploit, an insect colony must take into account at least two constraints: the resource must be abundant enough to sustain the whole group, but not too large to limit exploitation costs, and risks of conflicts with other colonies. Following recent results on cockroaches and ants, we introduce here a behavioral mechanism that satisfies these two constraints. Individu...

Self-organized Balanced Resources in Random Networks with Transportation Bandwidths

We apply statistical physics to study the task of resource allocation in random networks with limited bandwidths for the transportation of resources along the links. We derive algorithms which searches the optimal solution without the need of a global optimizer. For networks with uniformly high connectivity, the resource shortage of a node becomes a well-defined function of its capacity. An eff...

Self-organized Hierarchical Softmax

We propose a new self-organizing hierarchical softmax formulation for neural-network-based language models over large vocabularies. Instead of using a predefined hierarchical structure, our approach is capable of learning word clusters with clear syntactical and semantic meaning during the language model training process. We provide experiments on standard benchmarks for language modeling and s...

Self-Organized Criticality

The concept of self-organized criticality (SOC) has been evoked by Bak, Tang and Wiesenfeld (BTW) as a possible unifying framework to describe a vast class of dynamically driven systems which evolve spontaneously toward a critical stationary state with no characteristic time or length scale. In this essay we will discuss SOC models that have been studied and to what extent they are related to r...

Criticality, self-organized